Papers with gradient-free framework
Personalized Federated Learning for Text Classification with Gradient-Free Prompt Tuning (2024.findings-naacl)
Copied to clipboard
Rui Wang, Tong Yu, Ruiyi Zhang, Sungchul Kim, Ryan Rossi, Handong Zhao, Junda Wu, Subrata Mitra, Lina Yao, Ricardo Henao
| Challenge: | Pretrained language models (PLMs) are used for personalized federated learning . communication costs are high with large PLMs, and local training is expensive . |
| Approach: | They propose a framework for federated learning with pretrained language models . they propose 'discrete local search' and compression mechanism for local training . |
| Outcome: | The proposed framework achieves superior performance compared with baselines. |
From Heads to Neurons: Causal Attribution and Steering in Multi-Task Vision–Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing models focus on single tasks, limiting comparability of neuron importance . ranking strategies overlook how task-dependent information pathways shape write-in effects of feed-forward network (FFN) neurons. |
| Approach: | They propose a gradient-free framework for task-aware neuron attribution and steering in multi-task vision-language models. |
| Outcome: | The proposed framework outperforms existing methods in identifying task-critical neurons and improves model performance after steering. |